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SYSTEM AND METHOD FOR OPTIMIZING THE STORAGE AND PROCESSING 
OF DIGITAL IMAGES ON A DISTRIBUTED COMPUTER NETWORK 



FIELD OF THE INVENTION 

The present invention relates to a method for 
effective storage, access, processing and reprint 
fulfillment of digital images on a distributed computer 
network. In particular, this invention relates to a method 
which provides efficiencies with respect to communications 
bandwidth while delivering both a consistent visual image 
access behavior and high-quality reprints. 



€t BACKGROU ND OF THE INVENTION 

f; 15 The present invention relates to an improved 

s method and system of online storage, access, retrieval and 

•rf processing of digital images and the related reprint 

q fulfillment process. More specifically, it addresses the 

image quality vs. cost of transmission equation that has 

pi 20 been a significant impediment to the sale of enlargements. 

Current high-speed retail digital reprint systems 
date back to the initial installations in the early 1990' s. 
One, if not the first of such installations, consisting of 

25 a Kodak RFS 2035 Film Scanner, a networked IBM PS/2 

computer and Kodak XLS83 00 dye sublimation printer was 
installed by "Your Expression Personalized Greetings Inc." 
in a retail plaza in downtown Toronto in December 1993 . 
Customers entering the store with film negatives were 

3 0 offered a high-speed, high-resolution (commonly referred to 
as "16-base") film scan transferring the image to the 
networked computer. Cropping and other editing of the 
, image then occurred on the computer and the resulting image 
was printed on a dye sublimation printer. Optionally, the 

3 5 customer could specify a name for the image (typically 

their initials and a frame number) and the image would then 
be stored on a networked file server. The networked file 
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server, running the IBM Lan Server operating system, was 
attached to remote systems through a dial-up telephone line 
but since the 16 -base image was 18MB in size, rarely was 
the original image transferred without first being 
5 significantly compressed, typically using JPEG, resulting 
in quality loss. Thus, subsequent prints made from the 
transferred image were inferior to the first reprint made 
at time of scan. 

10 As the internet emerged and demands for the 

transmission of digital images grew, common approaches to 
the image size vs. transmission time equation appeared. 
One approach, popularized by Kodak's "PhotoNet" online 
service, was not only to significantly JPEG compress the 

15 images before transmission, but to also significantly 

reduce the target original image size before compression by 
creating only low resolution (commonly referred to as "4- 
base" ) scans. This meant that one entire roll of scanned 
negatives in the PhotoNet system could be transferred over 

2 0 the internet in far less time than one of the original 
scans made by the Your Expression system. 

While there is little or no visual difference to 
consumers in a heavily compressed 4 -base image and an 

2 5 original 16 -base image when viewed onscreen and reprinted 

at sizes such as 4x6 and 5x7 inches, larger reprints and 
cropping operations make the compressed 4 -base images 
inadequate. As photof inishing retailers face little (if 
any) profit margin on small reprints, a method is needed 

3 0 whereby the quality benefits of 16 -base scans can be 

achieved using existing, affordable network bandwidth. 



SUMMARY OF THE INVENTION 
3 5 The system and method of the present invention 

provides the user with full information and records with 
sufficient accuracy to place an order. Once an order is 
received, the full digital record is retrieved and if 
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necessary, transmitted to an appropriate site to allow the 
order to be processed. In this way, only full records for 
which an order has been received, are transmitted and in 
many cases, the records may already be present with the 
5 particular premise where the full record is maintained. 

The method of the present invention includes the 
steps of storing original film scans on a local file server 
and transferring proxies of such images to a central photo 
10 sharing community website, together with a pointer to the 
original file server and corresponding film scan; allowing 
M= an authorized user to access the community website and the 

particular images associated with the user; providing tools 

D 

ffi for the user to modify and adjust the images; providing an 

S 15 arrangement for placing an order with respect to an image 
ff-, or adjusted image together with the instruction set of any 

M modifications that have been made to the image; providing 

said instruction set to the original file server; modifying 
[y the original image using the instruction set provided with 

~tf 2 0 the order information to produce a high quality image as 
."i ordered by the user and providing the image to the 

customer. 



2 5 BRIEF DESCRIPTION OF THE DRAWINGS 

Preferred embodiments of the invention are shown in 
the drawings, wherein: 

Figure 1 is a schematic overview showing a 
community website, a series of users and a series of 

3 0 related retail outlets; and 

Figure 2 is a schematic showing certain features of 
the community website. 



35 DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

With the present arrangement as shown in Figure 
1, there can be a series of retail outlets 8 and each 
retail outlet 8 can include its own associated file server 
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10 on which full images are loaded and stored. Proxies of 
these images are posted to the photo sharing community- 
website 4. The proxies of the images are of reduced quality 
and resolution to allow for more cost effective 
5 transmission to the community website. Any user 2 can 

access the community website 4 and review the authorized 
images and prepare modifications thereof and place an order 
of such images, with any of the retail outlets 8. If the 
order is placed with the retail outlet that originally 
10 stored the full image, then that outlet can process the 
full image and produce the ordered product for the 

Q customer. In some cases, the customer may have designated 

O 

j£ a different retail outlet. In this case, the original high 

SJ quality image is transmitted from the first file server to 

;Sj 15 the file server of the designated retail outlet. This 

|=4 outlet then completes the order and provides the finished 

product for the customer. In some cases, the retail 

fll outlets may merely send the finished product to the 

~ selected outlet using conventional means. 

S 2 0 

f|j With this system and method, transmission of full 

high quality images, i.e., 16 base images (although 4 base 
or other resolutions are also possible) , is minimized, and 
at least, limited to the fulfillment of orders. Proxies of 

25 the fully scanned images of reduced accuracy and resolution 
are transmitted to a community website. Typically, the 
proxies are of sufficient quality for the customer to 
effectively view the images over a computer network. For 
example, the image, when viewed on a computer monitor, will 

3 0 be of the same approximate quality, whether the image is a 
4 base image or a 16 base image. Therefore, if a customer 
has 3 6 digital images scanned and the proxies posted to the 
community website, these posted images will all be of 
reduced quality, i.e., typically 4 base or lower resolution 

35 images. The customer may seek to modify one or two of 

these images and determine what modifications, enlargements 
and cropping, etc. that may be desired on the community 
website and view the modified image, in accordance with his 
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instructions. He can then place an order for that modified 
image for pick up at a retail outlet. 

The instructions with respect to the modified 
5 image are transferred to the retail outlet and the retail 
outlet will either retrieve the original high resolution 
image from its own database or have the high resolution 
image transmitted from one of its associated retail 
outlets. In this way, the original images are only 
10 transmitted when an order is received and only a small 

number of the images will actually be transmitted. This 
M system provides the full advantages of low cost or free 

S viewing and editing by the user, and encouragement of 

additional orders at a higher margin. The cost of offering 
5 this service are greatly reduced as the memory storage on 
ffi the community website and transmission costs are less 

demanding due to the significant reduction in the quality 
q of the image available to the user. This is basically 

OJ transparent to the user as he is viewing these images, 

H 

^ 2 0 using a monitor where this reduction is not immediately 
C3 apparent . 



With this system, the community website provides 
full access to the image proxies which include a pointer or 
address back to the high quality original images. High 
quality original images are only transmitted when an order 
is received and often transmission is not required. 
Instructions with respect to image manipulation are 
transmitted and then used to adjust the high quality image 
shortly before printing at the fulfilling location. 

With this arrangement, the advantage of posting 
images to a central website is achieved without eliminating 
the original high quality scan. Large reprints of high 
quality are achieved as the high quality original image is 
modified in accordance with a user determined instruction 
set . 



- 5 - 



WH-11, 110-1US 



In a preferred, aspect of the invention, certain 
customers can have enhanced services and can have the 
original scanned images images transmitted from the 
original file server to the community website to support 
5 special viewing or modification. This might be necessary 
where a very small portion of an image is to be considered 
for enlargement and the quality of the previously uploaded 
proxy image on the web server would not be sufficient . 
Alternatively, these instructions can be transmitted to the 

10 original file server and only that portion of the original 
image, which is to be enlarged or otherwise modified, need 
be transmitted to the web server at the standard for the 
web server (i.e., typically 4 base resolution or lower) . A 
further alternative enables the community server to send 

15 instructions to the original file server to produce a 

portion of the original image at a resolution desirable for 
the customer - such new proxy image to be transmitted 
directly from the original file server to the web browser 
of the customer under control of the community website. 

20 Again, the transmission costs in all these approaches are 
reduced and the desired image of the customer is provided 
to him at a quality which is appropriate for the viewing or 
modification technique at hand. This service could include 
a certain fee or charge. 

25 

A further opportunity for increased profit margin 
for retailers is in the sale of higher-resolution scans. 
Existing systems categorize all customers, and all images, 
in one group and do not recognize that the proliferation of 

3 0 knowledge of digital imaging is creating groups of 

customers who would pay for better quality film scans. 
Existing systems also do not recognize that some images are 
more valuable to such customers than others. With the 
present system, users can optionally specify a superior 

3 5 service such as long term retention of high quality images. 
Thus a system allowing for the dynamic categorization of 
images and customers based on their quality desires is 
achieved and appropriate compensation charged. 
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A further related area of this invention includes 
the ability to crop, edit and use images in compositions 
for final output through the manipulation of a lower- 
5 resolution "proxy" of the original image. Object -based 
procedures, such as described in "Method of Rendering an 
Image" US patent #59032 77, make this possible and negate 
the need to have a high- resolution original online for 
editing, compositing and cropping operations and this 
10 invention integrates the use of such capabilities. 

Furthermore, existing web-based systems which attempt to 
tl build complex compositions centrally requiring fine fonts 

y 

Q or other detail are often faced with producing files of 

m 

over 30MB in size which have to be transmitted, with only 

-£\ 15 lossless compression, to print fulfilling locations. This 

P invention distributes the final processing of such 

6 compositions to the fulfilling locations and thus negates 



-Q the need to move final compositions long distances 

J=5 needlessly consuming communications resources. 



The overall system shown in Figure 1 has a number 
of users 2 that access using the internet or other 
available network the storage website 4. This storage 
website has received from one of the various retail outlets 
8 , reduced quality digital records such as digital 
photographs which have been stored in accordance with 
information provided by the user. The user can then access 
these digital records and review them in a reduced quality 
which is satisfactory for review and transmission over the 
internet. The web storage site 4 also allows the user to 
modify these images, crop them, mosaic them, and a host of 
other tools, and preview the resulting product. 

Basically the user is allowed free access to allow 
a host of different modifications with the possibility of a 
further sale for the modified image. The finished product 
will not use the quality of the images stored on the 
storage website 4 as these were of reduced accuracy 
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suitable for transmission over a network and for display by 
the user. If the user decides to proceed with an 
enlargement, for example, which has been cropped and 
possibly colour corrected, an order is placed, together 
5 with the instruction set for modifying the image, and 

perhaps even the modified 4 base image. The user will also 
designate which retail outlet (or other fulfillment 
location) he would like to attend at or have the service 
completed on his behalf. 

0 

In many cases, this will be the same store that 
originally received his film developing or scanning, and 
thus, the store will have in its own 16 base (or other 
original resolution) storage indicated as 10, the actual 
2 ] 15 detailed record. In this case, that store would then 

complete the order (and process the list of modifications 
M against the original resolution images, as required) on 

p, behalf of the user and the user would pay that retail 

ft! outlet or, alternatively, pay the community web service 

r , 

2 0 online who would compensate the retail outlet on completion 
Q of the transaction. With this arrangement, transmission of 

the detailed record across the network has not occurred and 
only the simplified images were transmitted to the storage 
website. This greatly reduces the complexity with respect 

25 to the storage website 4 and also greatly reduces 
transmission time and cost. 



In some cases, the user may wish to pick up his 
order at a different retail outlet than the outlet that 

3 0 originally converted his film records to 16 base (or other 
original resolution) digital records. Therefore, 
instructions may come to store 3 whereas the actual 
detailed record is at the file server at store 1. Store 3 
would then provide instructions to store 1 with respect to 

35 transmission of the actual digital record required to allow 
the order to be completed, and store 1 would transmit this 
record to store 3 . Once again, only transmission of the 
required digital record is made across the network and as 

- 8 - 



WH-11, 110-1US 



can be appreciated, many of the 16 base (or other original 
resolution) digital records will never be transmitted 
across the network. Furthermore, transmission of the 
detailed record across the network is only based on an 
5 order being placed, and therefore, the transmission costs 
can be built into the pricing model. Instructions arriving 
at Store 3 might require detailed records from multiple 
stores to be retrieved before more complex compositing or 
other operations involving multiple images can be completed 
10 at Store 3 to produce the desired print. 

H With this system, the convenience and encouragement 

is provided for the user to view his images and modify the 
\i images, using the storage website 4. This enhancement is 

%U 15 accomplished in a cost effective manner and any reduction 
y. in quality is basically transparent to the user. As can be 

appreciated, the user will be reviewing these records on a 
monitor and the 4 base (or lower resolution) digital 



a 
ni 

Q records will be sufficient. Furthermore, the user places 

m 



an order based on the modified 4 base (or lower resolution) 
image and as such, the final product when it is received 
will be more accurate and of higher quality. 



The community website 4 can also have associated 

2 5 therewith, a long term storage charge which is paid for by 

a user. For example, a user may review 3 6 4 base (or lower 
resolution proxy) images corresponding to his film that he 
has dropped off at store 1. Of these 36 images, he has 
determined that four of them are excellent records and 

3 0 although he does not wish to order them at this time, he 

does wish to pay for storage on a long term basis. These 
four high quality records can be transferred to the 
website. Such would then be available for reprint and 
composition orders for an extended time. 

35 

The community website 4 can also use the same proxy 
method to enable other users who are authorized by the 
owner of the images to view the images and order reprints 
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or make compositions. Such other users might live anywhere 
in the world. Reprint requests would be fulfilled at a 
store or other contracted fulfillment location near such 
other users worldwide in a manner identical to the process 
5 outlined herein where the fulfilling location must 

retrieve, upon receipt of the order and associated image 
processing information, the original images from the 
original scanning location or, if the original images have 
been stored by their owner on the community website, 
10 directly from that website. In the event that at a given 
time of reprint order, the original images are located at 
y both the original scanning location and the community 

C3 website, the order and image processing information will 

contain both such pointers so that the fulfilling location 
5 can make a determination as to the best route to use to 
retrieve the original images. 



D 



m 



The present system and method facilitates the 
fTj online ordering, processing and production of high-quality 

0 enlargements from high-resolution (or losslessly compressed 
4-base) images without incurring significant incremental 
fy transmission costs; allows customers who wish to pay for 

high-quality film scans and relating products the ability 
to do so without incurring significant costs for the 
2 5 retailer against all customer film scanning; and allows 

customers, who discover after their film has been developed 
and scanned, that one or more specific images are those 
"once in a lifetime moments" that should be preserved in a 
higher-resolution form. 

30 

1) The customer's account is entered into a scanning 

station where film frames are then scanned and the 
resulting images are transferred to a locally networked 
file server. Should the customer not have an existing 
35 account with the retailer, a number of methods of 

assigning an account may be used including customer's 
phone number, name, etc., which are not critical to the 
invention. Typically, these scanning stations will be 
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scanning at 16-base or higher resolution and typically a 
lossless or near lossless compression is the only 
compression applied to such images before storage on the 
locally networked file server. 

5 

2) Each image is given a unique identifier 
automatically by the scanning station (this may consist of 
the time and date of the scan with a reference to the 
customer account, or retail location or in other manners 

10 such that every image has a unique identifier) . 

3) Code running on the locally networked file server 
produces image proxies from each stored scanned image and 
automatically transfers each proxy to a specialized 

15 central internet photo sharing community web site. These 
proxies are of adequate resolution and quality for screen 
display, typically 4 -base images or as small as 4 00x400 
pixels as they are never intended for reprint purposes. 
Transferred proxies are tagged with appropriate customer 

2 0 account information and are placed in an incoming album in 
the account of the customer, all without any further 
manual intervention from the retailer. 

4) When the customer accesses an account over the 

2 5 internet, the central internet photo sharing community web 

site then displays the image proxies and is designed to 
support albuming and other common online operations plus 
proxy editing, cropping and compositions using the proxies 
rather than the original images. In the preferred 

3 0 embodiment, the central website converts all such 

operations (the "image processing" operations) to 
postscript where possible. 

5) When a reprint is ordered, any image processing 
3 5 operations are sent with a unique reference to the 

originally scanned image (or images, if more than one 
image is used in a composition) to a print server at the 
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print fulfilling location along with corresponding order 
identification and processing information. 

6) Should the print fulfilling location be the same 
location where the film was originally scanned, the 
originally scanned image will already be local to the 
print server but if the fulfilling location is different 
from that where the original scan was made, the print 
server at the fulfilling location will automatically fetch 
the original image from the original scanning location or 
in the event that a multitude of images is required to 
complete the processing of a more complex composition, the 
print server will fetch sue multitude of images from any 
number of remote locations as necessary. 

7) Now having the image processing operations and 
the original image (or images) , the print server executes 
the processing operations against the original image (s) 
and produces the highest-possible quality enlargement or 
reprint. Note that communications bandwidth is only 
consumed by the transfer of the high- resolution images 
where a reprint has been ordered - and not by the transfer 
of all original scans as is the case with existing 
internet photof inishing systems linking with photo 
community sharing websites. Note also that although this 
method refers to reprints and enlargements, it is 
applicable to all photographic products like mugs, 
calendars, mousepads, photo-greeting cards, etc. 

3 0 8) The originally scanned images will be 

automatically deleted over time as the local file servers 
manage their storage in conjunction with the central 
internet photo sharing community web site which will give 
customer viewing images time to decide if such customer 

35 wishes to pay for longer term, higher- security storage or 
other options for the original film scans. For example, 
3 0 days prior to the flush of a given set of original 
scans, a customer could be offered individually priced 
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packages to store all, or selected images for varying 
periods. Such payment would then offset the communication 
cost of moving the original scans to the central web site. 
Facilities at the central web site would then typically 
offer increased redundancy including options for optical 
backup and off -site storage. 

9) Customers might also opt to combine a series of 
original scans onto one CD, ordered according to their 
desires, not according to frame number. The production of 
such CDs would then require the gathering of all original 
scans from various distributed local file servers but such 
communication cost for those specific images would be 
offset by the revenue from the sale of such CD. Should 
any image processing operations have been applied to the 
proxies, such would also be applied to the original images 
before writing to CD. 

10) Customers who have special, "premium" online 
accounts might be offered special pan and zoom or other 
functionality requiring dynamic access to the original 
film scanned images and in such event, to meet this 
requirement, either the original image would be 
dynamically transferred to servers at the central internet 
photo sharing community site for appropriate 
retransmission to such customer, or such function would be 
provided directly by the file server holding the original 
image, but in either case, transparently to the customer. 

11) It is also supported within this invention that a 
customer of a given scanning location would be able to 
order enlargements and other photographic products at the 
time of scanning which may not necessarily be fulfillable 
at the given scanning location. For example, the scanning 
location may have a digital minilab capable of only 4x6 
output but the customer wishes 5x7 ' s . In this case, the 
scanning location' s file server could dynamically generate 
a print fulfillment request at any remote print server 
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which would then fetch the original images from the 
scanning file server when such remote print server had 
available bandwidth and was queuing 5x7 print jobs. 

The present invention can also be used to address 
memory problems associated with many digital cameras. 
These cameras often have flash memory cards for recording 
of the digital images . The number of images that can be 
stored is dependent upon the image quality but in many 
circumstances, there is a shortage of memory. To overcome 
this issue, a store outlet or kiosk can, for a fee, record 
the high quality images on a local server and transfer 
proxy images to the website. The user can then reuse the 
flash memory cards and repeat the process if necessary. 
This service is particularly valuable on trips where access 
to a personal computer or personal hard drive is not 
convenient, and the user can later decide when viewing his 
proxies on the community website, whether to purchase long 
term storage of the high- resolution original records, or to 
order reprints and other services in a manner identical to 
that whereby the original image records came from film 
scans instead of a digital source at the original retail 
location. 

25 The present invention can also be used to address 

the sale of professional image content where such content 
might be hosted at a remote location with only proxy images 
made available to the public on photo sharing community 
websites. In the event that an image or composition is 

3 0 ordered which includes such professional content, the 
fulfilling location, having received the order with 
applicable image processing and composition information, 
will use the pointers within the order to make a direct 
connection to the source or sources of the original high- 

3 5 resolution image content and retrieve such content without 
the consumer having access to these originals in digital 
form. After fulfillment, the original images containing 
professional content would be deleted from the print 
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servers unless an arrangement was in place whereby secure 
temporary storage was permitted by the content owners, and 
in this case, the high resolution originals would only be 
stored for a period related to the expectation that such 
content would be needed by the ful filler on a frequent 
basis. In all cases, the pointers within the order 
allowing the fulfillment location to retrieve high 
resolution professional content would be provided under 
contract with such content owners, such contract might 
include the payment of a royalty for each print which would 
be tracked in accordance with the contract by the community 
website or fulfillment partner. 

Although various preferred embodiments of the 
present invention have been described herein in detail, it 
will be appreciated by those skilled in the art, that 
variations may be made thereto without departing from the 
spirit of the invention or the scope of the appended 
claims. 



